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I.   INTRODUCTION 

A.   BACKGROUND 

As  early  as  February  1969,  the  Department  of  Defense 
(DoD)  began  to  place  emphasis  upon  increasing  efficiency 
and  productivity  within  its  department.   This  was  also 
complementary  to  the  overall  efforts  of  the  federal  govern- 
ment.  These  efforts  led  to  the  creation  of  the  Defense 
Productivity  Program  (DPP)  whose  primary  objective  is  "to 
achieve  optimum  productivity  growth  (increase  the  amount 
of  goods  produced  or  services  rendered  in  relation  to  the 
amount  of  resources  expended)  throughout  DoD"  [6:  pg.  1J . 
It  should  be  noted  that  this  does  not  include  contractors. 
It  is  intended  solely  for  DoD  and  the  Service  Components. 
Furthermore,  this  approach  called  for  the  development  of 
Productivity  Enhancing  Capital  Investments  (PECIs) .   Responsi- 
bility for  the  administration  of  the  program  was  assigned  to 
the  Assistant  Secretary  of  Defense;  Manpower,  Reserve  Affairs 
and  Logistics  (ASD(MRA&L) )  who  designated  his  authority  to 
the  Defense  Productivity  Program  Office  (DPPO) .   This  Office 
acts  as  the  coordinator  for  the  DPP  and  serves  as  liaison 
between  the  Office  of  the  Secretary  of  Defense  (OSD)  and 
Service  Components  in  productivity  matters. 

One  of  the  problems  faced  by  DPPO  in  the  management  of 
PECIs  was  the  process  of  allocating  funds.   Due  to  budget 


constraints,  not  all  of  the  recommended  productivity  projects 
could  receive  funds.   To  alleviate  this  dilemma,  projects 
are  ranked  according  to  three  economic  indicators:   internal 
rate  of  return  (IRR) ;  return  on  investment  (ROD ;  and  invest- 
ment per  manpower  space  saved  (INVPERSV) .   Projects  then 
receive  funding  according  to  their  rank  until  the  budget 
for  that  fiscal  year  is  exhausted. 

B.  STATEMENT  OF  THE  PROBLEM 

DPPO ' s  concern  is  to  ensure  that  funds  are  allotted 
to  the  most  productive  projects.   Considering  that  projects 
forecast  uncertain  savings  and  costs  into  the  future,  this 
is  an  understandable  concern.   Under  the  present  procedure, 
DPPO  can  only  validate  the  use  of  correct  discount  rates  in 
making  these  predictions.   However,  the  realization  of  these 
forecasted  costs  and  savings  is  questionable.   The  introduc- 
tion of  methods  involving  risk  and  uncertainty  may  aid  in 
the  efficient  allocation  of  funds.   The  question  to  be 
addressed  in  this  thesis  is  whether  or  not  the  use  of  risk 
and  uncertainty  techniques  will  significantly  change  the 
current  ranking  of  projects. 

C.  OBJECTIVES  OF  THE  ANALYSIS 

The  objectives  of  this  analysis  will  be  to  develop  a 
model  incorporating  uncertainty,  rank  the  projects  using  the 
model,  and  compare  these  results  to  the  current  ranked  list. 
Since  the  present  method  ranks  projects  according  to  IRR, 
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ROI,  and  INVPERSV,  the  model  will  apply  risk  factors  to  these 
areas.   The  model  will  not  introduce  any  new  variables  (e.g., 
net  present  value,  payback  period,  etc.)  which  might  affect 
the  rankings.   Furthermore,  only  those  equations  used  by 
DPPO  to  calculate  economic  indicators  will  be  presented  in 
the  model  unless  a  simpler  formula  exists  that  portrays 
identical  behavior.   This  specifically  refers  to  the  method 
used  to  compute  IRR.   The  current  method  uses  average  yearly 
savings  and  the  model  utilizes  constant  yearly  savings. 
Although  the  formulas  will  result  in  different  IRRs,  any 
change  in  savings  will  result  in  an  equi-proportional  change 
in  rate  of  return. 

Additionally,  sensitivity  analysis  will  be  performed  on 
the  model.   Initial  analysis  will  restrict  itself  to  the 
single  variable  case  and  will  be  expanded  later  to  consider 
multivariable  deviations.   The  purpose  of  this  analysis  will 
be  to  determine  the  level  of  change  of  input  variables  to 
effect  a  change  in  ranking. 

D.   CONTENTS 

The  following  chapter  introduces  the  reader  to  DPPO  and 
the  Productivity  Investment  Fund  (PIF) .   The  background  of 
DPPO  and  its  functions,  an  overview  of  PECI's,  the  PIF's 
past  funding  levels,  and  procedures  used  to  obtain  these 
funds  will  be  addressed.   Chapter  III  will  familiarize  the 
reader  with  risk  and  uncertainty  as  well  as  techniques  in 
dealing  with  each.   It  will  further  apply  the  use  of 
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uncertainty  to  the  PIF.   Chapter  IV  defines  the  terms  and 
gives  a  detailed  description  of  the  model.   It  will  explain 
how  branch  values  were  obtained  and  discuss  the  basic 
assumptions  of  the  model.   In  Chapter  V,  the  ranking  derived 
using  uncertainty  will  be  compared  to  the  current  ranking, 
sensitivity  analysis  performed,  and  the  results  of  the  analysis 
revealed.   Chapter  VI  will  summarize  this  thesis  and  present 
conclusions  and  recommendations  derived  therefrom. 
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II.   DEFENSE  PRODUCTIVITY  PROGRAM  OFFICE  (DPPQ) 

A.   BACKGROUND 

As  previously  stated,  emphasis  on  productivity  and 
efficiency  within  the  Department  of  Defense  (DoD)  began 
in  1969.   Initial  attempts  called  for  the  establishment  of 
the  Defense  Economic  Analysis  Council  in  October  19  72.   This 
council  served  in  an  advisory  capacity  to  the  Assistant 
Secretary  of  Defense  (Comptroller)  and  encouraged  the  appli- 
cation of  economic  analysis  and  program  evaluation  in  order 
to  increase  the  cost  effectiveness  of  budget  proposal  inputs 
to  the  Planning,  Programming  and  Budgeting  System  (PPBS) . 
In  August  19  75,  DoD  Directive  5010.31  established  the  De- 
fense Productivity  Program.   The  primary  objective  of  the 
program  is  "to  achieve  optimum  productivity  growth  (increase 
the  amount  of  goods  produced  or  services  rendered  in  relation 
to  the  amount  of  resources  expended)  throughout  DoD"  [6: 
pg.  1] .   This  directive  required  Defense  organizations  to 
be  both  effective  and  efficient  in  the  utilization  of  all 
types  of  fund  resources  (operating  and  investment)  as  well 
as  labor  resources.   Furthermore,  the  directive  identified 
productivity  measurement,  productivity  enhancement,  and 
productivity  evaluation  as  key  elements  to  the  program. 
Although  all  three  elements  play  important  roles  in  the 
program's  success,  only  Productivity  Enhancement  (PE)  will 
be  discussed  in  this  paper. 
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In  19  79  DoD  Directive  5010.31  was  reissued,  forming  the 
Defense  Productivity  Program  Office  (DPPO)  which  had  over- 
all responsibility  of  the  Defense  Productivity  Program  (DDP) 
DPPO  was  placed  under  the  cognizance  of  the  Assistant  Secre- 
tary of  Defense  (Manpower,  Reserve  Affairs  and  Logistics) 
(ASD,  MR&L)  in  1981. 

The  DPP  to  be  developed  would  include  a  planned  approach 
to  PE  including,  but  not  limited  to,  the  development  of 
Productivity  Enhancing  Capital  Investment  (PECI)  programs. 
PECIs  are  classified  as: 

1.  Office  of  the  Secretary  of  Defense  (OSD)  sponsored 
projects; 

2.  Industrial  Fund  Fast  Payback  (IFFP)  projects;  and 

3.  Other  Component  Sponsored  Investment  (CSI)  projects. 
OSD  sponsored  projects  include  the  following  categories: 

a.  Productivity  Enhancing  Incentive  Fund  (PEIF)  projects. 

These  projects  are 

...fast  payback  PECI  projects  financed  from  drawing 
accounts  established  within  annual  appropriations . 
These  projects  cannot  exceed  $100,000  or  cost 
limitations  established  by  OSD  (whichever  is 
greater)  and  must  amortize  within  2  years  of 
the  date  they  become  operational.   [7:  pg.  4] 

b.  Productivity  Investment  Fund  (PIF)  projects. 

These  are  projects  that  have  been 

...competitively  selected  by  OSD  from  candidate 
proposals  submitted  by  DoD  Components  and  financed 
through  traditional  budget  appropriation  processes 
from  funds  set  aside  by  OSD  for  this  purpose. 
PIF  projects  must  be  expected  to  amortize  within 
4  years  of  the  date  they  become  operational. 
[7:  pg.  4] 
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Since  this  thesis  will  deal  only  with  PIF  projects,  discussion 
on  PEIF,  IFFP  and  CSI  projects  will  be  omitted.   However, 
PIF  funding  levels  and  procedures  will  be  of  interest  later 
and  will  be  the  next  topic. 

B.  PRODUCTIVITY  INVESTMENT  FUND  (PIF)  FUNDING  LEVELS 

To  better  understand  the  magnitude  of  these  investments, 
a  look  at  past  and  proposed  funding  levels  may  prove  bene- 
ficial.  The  first  PIFs  were  funded  in  19  81.   Money  for  the 
program  was  $105  million  that  year  and  $110  million  for  19  82. 
David  Whipple  and  Jack  LaPatra  [15]  completed  an  evaluation 
of  DPPO's  activities  revealing, 

The  average  cost  of  PIFs  has  been  $2  million,  with 
an  average  payback  of  2.5  years.   Having  an  average 
lifetime  investment  of  $11.2  million,  they  are 
expected  to  return  $6  for  $1  invested.   Approximately 
$700  million  has  been  requested  under  PIF  by  all 
services  for  FY  83-87.   [15:  pg.  V-15J 

The  average  cost  of  proposed  projects  for  FY84  budgeting  is 

approximately  $1.6  million,  slightly  less  than  previous 

years .   How  a  Service  Component  proceeds  to  obtain  funding 

for  a  productivity  project  is  the  next  topic. 

C.  PIF  FUNDING  PROCEDURE 

Department  of  Defense  Instruction  (DoDI)  5010.36  estab- 
lishes policy  and  prescribes  procedures  for  the  Productivity 
Enhancing  Capital  Investment  (PECI)  program  with  which  the 
PIF  is  affiliated.  Excerpts  from  this  directive  concerning 
policy  indicate  the  intent  of  the  program  by  stating,  "PECI 
funding  procedures  focus  upon  financing  those  projects  that 
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substitute  capital  for  labor"  [7:  pg.  2] .   In  yet  another 

section,  guidelines  for  project  selection  is  delineated, 

Top  priority  will  be  given  to  those  potential  invest- 
ments that  amortize  in  the  shortest  period  of  time 
and  those  with  the  highest  potential  internal 
rate  of  return  on  investment  or  the  highest  net 
present  value.   [7:  pg.  2] 

Furthermore,  the  instruction  dictates  a  specific  format  for 
DoD  Components  to  follow  when  requesting  money  for  produc- 
tivity projects.   A  copy  of  the  format  is  contained  in 
Reference  7.    Some  of  the  required  information  that  will 
be  of  particular  interest  later  includes  total  cost,  total 
savings,  internal  rate  of  return  ( IRR) ,  savings  to  investment 
ratio,  rate  of  investment  per  manpower  space  and  cost-benefit 
streams.   These  concepts  are  explicitly  defined  and  evaluated 
in  Chapter  IV  below.   From  this  base,  net  present  value  (NPV) 
and  payback  period  (P-P)  can  be  calculated  and  economic 
analysis  performed.   For  purposes  of  uniformity,  the  term 
savings  to  investment  ratio  is  synonymous  with  return  on 
investment  (ROD  . 

The  sequence  of  events  from  project  initiation  to  project 
funding  may  be  outlined  as  follows: 

1.  A  DoD  Component  prepares  an  initial  proposal  for  a 
project  categorized  as  a  PIF  using  the  format  af  DoDI 
5010.36. 

2.  This  proposal  is  forwarded  via  the  appropriate  chain 
of  command  for  approval. 

3.  Each  service  then  compiles  a  list  of  the  "best"  proj- 
ects, normally  in  rank  order,  that  meets  its  needs  and  objectives 
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4.  These  lists  are  then  forwarded  to  DPPO  who  conducts 
an  economic  screen.   The  screening  process  consists  of 
recomputing  the  information  and  checking  the  accuracy  of 
each  proposal  in  terms  of  calculations  and  validity  of 
projections. 

5.  The  projects  are  separated  according  to  function, 
i.e.,  Automatic  Data  Processing  (ADP) ,  aircraft  maintenance, 
etc.,  and  forwarded  to  the  appropriate  Office  of  the  Secre- 
tary of  Defense  (OSD)  Functional  Manager  for  a  final  screening 

6.  Projects  are  returned  to  DPPO  who  computes  a  final 
ranking  of  all  approved  projects.   This  ranking  is  based  on 
three  key  indicators:   IRR,  ROI  and  Investment  Per  Manpower 
Space  Saved  (INVPERSV) .   Each  indicator  receives  equal  weight 
with  ties  in  rank  going  to  the  project  with  the  highest  IRR. 

7.  From  the  current  budget  set  aside  for  PIF  projects, 
all  out-year  funding  on  prior  approved  projects  is  deducted, 
i.e.,  a  FY81  project  requiring  funds  for  two  years  receives 
its  FY82  money  from  the  FY82  budget.   A  running  cumulative 
sum  of  investment  costs  on  currently  approved  projects  is 
performed  and  the  balance  of  PIF  monies  allotted.   It  should 
be  noted  that  not  all  projects  approved  will  be  funded. 

8.  DPPO  then  issues  a  Program  Budget  Decision  (PBD)  to 
the  services  who,  in  turn,  add  this  money  to  their  respective 
Service  Budget  requests. 

9.  Once  Congressional  approval  is  received,  as  it  usually 
is,  the  funds  are  appropriated  accordingly.   This  entire 
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cycle  takes  approximately  1  year  to  complete  and  any  project 
not  funded  that  year  may  reapply  the  following  year. 

At  this  point,  the  reader  should  have  a  basic  understand- 
ing of  DPPO,  PIF  and  the  procedures  used  to  obtain  project 
funding.   What  may  not  be  so  clear  is  the  role  that  risk 
and  uncertainty  play.   The  next  chapter  attempts  to  intro- 
duce these  terms  and  relate  them  to  the  PIF. 
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III.   RISK  AND  UNCERTAINTY 

A.   INTRODUCTION 

The  word  decision  may  be  defined  as  a  choice  among 
alternatives.   In  any  investment,  a  decision  may  be  made 
under  conditions  of  certainty,  risk,  or  uncertainty.   Cer- 
tainty postulates  that  the  decision  maker  knows  in  advance 
all  parameter  values  that  will  affect  the  decision.   With 
risk,  he  is  aware  of  all  future  states  that  will  affect  his 
decision  and  can  place  a  probability  distribution  on  the 
value  of  the  occurrence  of  each  state,  i.e.,  the  probability 
distribution  which  describes  possible  outcomes  is  known. 
According  to  Morris  [13] ,  uncertainty  implies  that  a  decision 
maker  may  or  may  not  be  aware  of  all  possible  states  and  may 
or  may  not  be  able  to  place  a  probability  distribution  on  the 
occurrence  of  each. 

Figure  1  depicts  a  decision  problem  represented  by  a 

payoff  matrix.   Here,  the  columns,  s,,s2,...,s  ,    represent 

future  states  of  nature  and  the  rows  a, ,a~....,a   are  the 
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alternatives.   The  P..'s,  where  i  =  l,2,...,m  and  j  =  l,2,...,n, 
represent  the  payoff  of  alternative  i  in  state  j .   If  a 
probability  distribution  can  be  placed  on  the  states  of 
nature,  then  Morris  [12] ,  Fishburn  [8] ,  Luce  [10]  and  Savage 
[14],  give  several  principles  that  may  be  used  to  aid  in 
decision  making.   These  principles,  expectation,  most  probable 
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Figure  1.   Typical  Payoff  Matrix 

future,  expectation-variance,  and  aspiration  level,  will  be 
discussed  in  detail  in  Chapter  IV.   If  the  decision  is  made 
under  uncertainty,  then  the  Laplace  Principle,  minimiax  or 
maximin,  minimin  or  maximax,  Savage's  minimax  regret,  and 
the  Hurwicz  principle  are  common  principles  of  choice. 

Clark,  et  al  [4]  explain  another  technique  in  dealing 
with  risk  and  uncertainty  known  as  Utility  Theory.   This 
is  an  attempt  to  formalize  rational  decision  making.   In 
this  approach,  preferences  among  alternatives  are  specified 
by  the  decision  maker.   The  utility  value  attached  to  the 
various  alternatives  then  represent  all  aspects  that  are 
relevant  to  the  decision. 

If  a  decision  maker  perceives  different  levels  of  risk 
associated  with  the  future  states ,  then  the  Certainty 
Equivalent  Method  may  prove  useful.   This  approach  permits 
adjustment  for  risk  by  incorporating  the  decision  maker's 
utility  preference  for  risk.   In  an  economic  scenario,  it 
is  reasonable  to  assume  that  estimates  of  cash  flows  are 
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likely  to  be  more  accurate  during  the  early  periods  of  an 
investment  than  in  the  later  years.   Subsequently,  the  risk 
should  be  adjusted  to  reflect  this.   In  dealing  with  simi- 
lar situations,  whether  economic  or  not,  the  certainty 
equivalent  method  may  be  preferred. 

Raiffa  [13]  explains  a  popular  decision  technique  known 
as  a  decision  flow  diagram  or  "tree."   Here,  a  manager  has 
several  courses  of  action  he  may  take.   For  each  course  of 
action,  there  may  be  several  consequences  associated  with 
it.   Furthermore,  with  each  consequence  there  exists  a 
probability  of  that  event  occurring.   Figure  2  depicts  a 
simple  example  of  a  decision  tree.   In  this  example,  a  deci- 
sion maker  has  a  choice  of  investing  $15,000  on  a  project. 


DON't  INVEST 


$0 


Unsuccessful  (0.2) 


Very  Successful  (0.3) 


-$10,000 


Marginally  Successful  (0.5)    S2Q 


000 


$60,000 


Figure  2.   A  Simple  Decision  Tree 

If  he  decides  not  to  invest,  he  gains  or  loses  nothing.   If 
he  invests,  then  the  project  will  be  unsuccessful  with 
probability  0.2,  marginally  successful  with  probability  of 
0.5  or  highly  successful  with  probability  0.3.   In  this 
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particular  case  the  decision  maker  faces  an  80  percent  chance 
of  a  successful  project.   Taking  this  one  step  further,  the 
principle  of  expectation  or  expected  value  can  be  used. 
Mathematically,  expected  value,  R  is 


N 
R   =    J"   R.P.  (1) 


i=l 


where 


R   is  expected  value, 

R.   is  the  value  of  the  ith  outcome, 

l  ' 

P.   is  the  probability  the  ith  outcome  occurs, 
N   is  the  total  number  of  outcomes. 

Applying  this  to  the  decision  tree  yields 

R  =   (-$10,000x0.2)  +  ($20,000x0.5)  +  ($60,000x0.3) 
=   $26,000. 

Depending  upon  the  decision  maker's  risk  posture,  i.e.,  the 
minimum  return  he  will  accept  on  this  investment,  he  may  or 
may  not  invest. 

It  should  be  noted  that  the  probabilities  associated  with 
the  occurrence  of  consequences  may  not  be  very  easy  to  obtain. 
When  reviewing  the  available  courses  of  action,  the  decision 
maker  always  has  the  option  of  delaying  a  decision  until 
further  data  can  be  gathered  which  might  provide  insight 
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into  the  results  of  the  various  choices.  However ,  delaying 
a  decision  usually  has  an  associated  cost.  This  cost  may 
be  in  terms  of  time,  money,  workforce  or  numerous  other 
things.  According  to  Mooney  [11],  significant  in  this  area 
are  the  benefits  derived  from  increased  information  and  the 
increase  in  certainty  as  a  function  of  time.  Figures  3  and 
4  graphically  illustrate  this  problem. 

The  dilemma  of  determining  how  much  information  is  cost 
effective  can  often  be  viewed  as  a  problem  itself.   How  one 
obtains  information  can  help  in  reducing  costs.   If  data  is 
readily  available,  the  tools  of  regression,  data  analysis, 
non-parametric  statistics  and  probability  theory  can  be  use- 
ful in  providing  a  structured  solution.   On  the  other  hand, 
if  facts  must  be  gathered,  then  other  techniques  may  be 
used  as  well.   Moody  [11]  suggests  several  non-mathematical 
means  available  including  consensus  thinking,  brainstorming, 
the  delphi  principle,  fish  bowling,  didactic  interaction  and 
collective  bargaining.   In  addition  to  the  above,  other  methods 
such  as  PERT  (Program  Evaluation  and  Review  Technique)  and 
QUID  (Quantified  Intrapersonal  Decision  Making)  are  becoming 
readily  accessible. 

B.   APPLICATION  OF  RISK  AND  UNCERTAINTY  TO  THE  PIF 

During  the  funding  process  for  Productivity  Investment 
Funds  (PIF) ,  each  project  is  checked  for  accuracy  in  its 
projections.  .Components  requesting  funds  review  and  analyze 
past  data  on  costs,  workloads,  etc.,  in  an  attempt  to  forecast 
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costs  and  savings  into  the  future.   These  savings  are  the 
key  to  calculating  such  indicators  as  internal  rate  of  return 
(IRR) ,  return  on  investment  (ROD  ,  and  investment  per  man- 
power space  saved  (INVPERSV) .   However  cautious  and  meticu- 
lous an  analyst  or  manager  may  be,  these  savings  may  or  may 
not  be  realized.   Techniques  of  risk  and  uncertainty  may 
aid  in  taking  futuristic  inputs  into  account  and  better 
predicting  savings.   An  example  might  best  portray  this 
statement. 

Consider  a  machine  that  extracts  rivets  from  aircraft 
wings  at  a  rework  facility.   The  investment  cost  of  the 
machine  is  $60,000.   Since  the  cost  incurred  is  in  the  very 
near  future,  it  will  be  assumed  to  be  accurate  (providing 
installation  costs,  transportation  costs,  etc.,  have  been 
incorporated) .   In  the  cost-benefit  stream,  savings  are 
forecast  to  be  $30,000  per  year  for  10  years.   Furthermore, 
assume  the  projected  savings  were  based  on  a  constant  work- 
load, that  of  the  current  level,  throughout  the  economic 
life  of  the  machine,  i.e.,  10  years.   Clearly  such  factors 
as  war,  depression  or  recession,  the  introduction  of  a  low 
maintenance  aircraft,  etc.,  could  substantially  increase 
or  decrease  the  workload  of  the  facility  and,  hence,  pro- 
jected savings.   The  list  of  factors  that  could  affect  the 
projections  is  practically  endless.   To  construct  a  model 
incorporating  all  of  these  factors  would  be  tedious  and  costly, 
with  the  model  becoming  unmanageable.   If  risk  and  uncertainty 
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were  used  on  a  macro  level,  most  of  these  problems  would  be 
alleviated.   (The  word  macro  is  used  here  to  distinguish  the 
analysis  from  a  micro  aspect.)   The  micro  aspect  of  analysis 
would  consider  each  factor,  to  achieve  the  final  result.   In 
the  macro  sense,  one  is  concerned  only  with  whether  or  not 
realized  savings  were  above,  below,  or  as  projected  without 
concern  for  the  factors  that  would  cause  it  to  deviate.   The 
macro  model  could  enhance  managability  and  still  yield 
workable  results,  especially  if  not  one,  but  50  to  100  projects 
had  to  be  dealt  with. 

The  impact  of  risk  and  uncertainty  in  dealing  with  PIF 
projects  should  be  apparent.   The  methodology  and  model  used 
toward  this  end  is  presented  in  following  chapters.   It 
should  be  noted  that  the  procedure  used  is  not  exclusive  to 
investments  alone,  nor  is  it  the  only  method  applicable  for 
analysis.   Variations  on  this  theme  will  also  be  mentioned 
later. 
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IV.   AN  ECONOMIC  MODEL 

A.   DEFINITIONS 

The  underlying  motive  of  any  business  is  to  make  a  profit- 
One  method  of  achieving  this  is  through  capital  investments. 
It  follows  that  managers  expect  money  invested  today  to  in- 
crease in  amount  as  time  passes  because  they  expect  to  earn 
a  profit  on  that  investment.   To  the  manager,  therefore,  the 
value  of  money  today  is  more  than  its  value  at  some  future 
time.   Anthony  and  Reese  [lj  make  an  interesting  analogy, 
"An  investment  is  thus  the  purchase  of  a  future  stream  of 
expected  cash  inflows"  [2:  pg.  710].   Cash  inflows  are  simply 
earnings  or  savings. 

If  several  investment  alternatives  exist,  then  a  basic 
criterion  must  be  established  for  the  purposes  of  comparison 
and  evaluation.   Although  five  criteria  are  explained  next, 
only  three  (IRR,  ROI,  INVPERSV)  are  used  by  DPPO. 

The  first  economic  indicator,  Net  Present  Value  (NPV).  , 
is  the  difference  in  the  present  value  of  the  benefits 
(savings)  and  the  present  value  of  the  costs  at  a  given 
discount  rate  (the  interest  rate  used  to  discount  or  calcu- 
late future  costs  and  benefits  so  as  to  arrive  at  their 
present  values) .   Mathematically,  this  may  be  expressed  as: 


NPV   =    I      £-r  -  A   ,  (2) 

t=l  (1  +  k) c     u 
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where: 


A-  =  present  value  of  the  cost  of  the  project, 

S.  =  savings  received  in  period  t, 

k  =  appropriate  discount  rate, 

t  =  time  period,  and 

n  =  useful  life  of  asset. 


If  A0  is  incurred  over  a  period  of  time,  then 


n     A 

AQ   =    I      ^  ,  (3) 

u     t=l  (1  +kl^ 


where  A   is  the  cost  during  period  t.   If  the  NPV  is  posi- 
tive, it  means  the  project  is  expected  to  yield  a  return  in 
excess  of  the  required  rate.   If  it  is  zero,  the  yield  is 
expected  to  equal  the  required  rate. 

The  discount  rate  that  equates  the  present  value  of 
the  future  cash  flows  with  the  present  value  costs  of  an 
investment  is  known  as  the  Internal  Rate  of  Return  (IRR) . 
This  is  calculated  by  determining  the  discount  rate  that 
will  make  the  NPV  zero: 


n     S 

I    H  -  A0    =    °  '  (4) 

t=l  (l+r)1    u 


where : 


r   =   IRR, 
S.   =   savings  received  in  period  t, 
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t   =   time  period, 
An   =   investment  cost,  and 
n   =   useful  life  of  asset. 


If  cash  inflows  are  uneven,  the  trial  and  error  method  is 
recommended.   Computers  ease  the  tediousness  of  the  compu- 
tation; however,  DoD  has  derived  a  more  simplistic  procedure. 
Dividing  the  project  cost  by  the  average  annual  savings  will 
yield  a  factor.   This  factor  and  the  number  of  years  in  the 
economic  life  of  the  project  can  be  used  to  enter  a  table 
and  select  the  IRR.   If  the  cash  inflows  are  even,  Anthony 
and  Reese  [1] ,  using  the  same  calculation,  offer  the  IRR 
based  upon  the  same  table  inputs. 

The  Payback  Period  (P-P)  refers  to  the  number  of  periods 
required  for  the  (undiscounted)  cumulative  cash  inflows  to 
have  the  same  value  as  the  investment  cost. 

Another  indicator,  Return  On  Investment  (ROT) ,  is  synony- 
mous with  the  savings  to  investment  ratio.   This  method  com- 
pares yearly  income  of  a  project  with  the  investment  in  the 
asset  [1:  pg.  52].   The  formula  used  by  DPPO  is: 

n 


I    St 


ROI   =   ^ (5) 


I      Ct 
t=l   C 


where : 


S.   =   savings  received  in  period  t 
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C.   =   costs  incurred  in  period  t 

t   =  time  period 

n   =   useful  life  of  the  asset. 

Finally,  the  Investment  Per  Manpower  Space  Saved 
(INVPERSV)  is  simply  an  indicator  that  compares  cost  to 
manpower.   A  manpower  space  is  best  defined  by  example. 
If  two  clerks  are  required  to  perform  a  task,  and  the 
introduction  of  a  new  system  requires  only  one  of  them, 
then  the  other  is  freed  and  can  be  assigned  elsewhere.   This 
equates  to  saving  one  manpower  space. 

B.   THE  MODEL 

Although  the  techniques  of  both  risk  and  uncertainty 
have  been  discussed,  the  model  that  will  be  presented  next 
will  deal  strictly  with  uncertainty.   This  is  not  to  say 
that  the  model  could  not  be  used  with  risk.   After  careful 
analyses  of  several  audit  reports,  there  was  not  enough  infor- 
mation to  derive  probability  distributions,  thus  eliminating 
the  introduction  of  risk.   In  particular,  the  audit  reports, 
for  the  most  part,  failed  to  compare  actual  (or  realized) 
costs  or  savings  to  that  which  was  proposed.   Without  this 
information,  it  would  be  extremely  difficult  to  obtain  proba- 
bility distributions  (the  use  of  subjective  probabilities 
could  have  been  used) .   Further  discussion  on  this  point  is 
contained  in  Chapter  VI . 

In  the  process  of  evaluating  and  ranking  PIF  projects, 
DPPO  used  three  indicators;  IRR,  ROI  and  INVPERSV.   The 
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model,  therefore,  will  contain  three  submodels  used  to 
evaluate  each  indicator  respectively.   A  tree  diagram  was 
used  in  each  submodel  in  order  to  present  the  different 
outcomes  in  an  orderly  fashion.   Figures  (5) ,  (6)  and  (7) 
are  graphical  representations  of  these  models.   The  under- 
lying assumption  used  in  the  development  of  each  diagram  is 
based  on  the  independence  of  cost,  savings,  manpower  space 
saved  (MPS)  and  cash  flow.   The  term  independence  is  used 
to  signify  that  an  outcome  of  one  variable  is  not  dependent 
on  any  of  the  others.   This  assumption  allows  one  to  branch 
out  the  different  future  states  of  nature  and  then  apply 
uncertainty  techniques. 

It  should  be  noted  that  the  IRR  model  utilizes  one  branch 
instead  of  two  as  represented  in  the  other  models.   This  was 
done  for  two  reasons.   The  first  is  that  Sciortino's  [1] 
audit  of  FASCAPs  (Fast-Payback  Capital  Investments)  revealed 
that  11.7  percent  of  all  funded  projects  resulted  in  cost 
overruns  of  10  percent  of  the  total  projected  cost.   This 
sum  did  not  appear  to  be  significant  in  comparison  to  the 
total  cost  of  all  of  the  funded  projects.   Secondly,  the 
program  used  to  evaluate  the  model  was  written  in  APL  (A  Pro- 
gramming Language) .   The  IRR  computation  was  derived  through 
an  iterative  loop  which,  in  APL,  can  be  costly  due  to  the 
limitations  of  APL's  capabilities  Cone  run  of  15  projects 
takes  approximately  10  minutes,  equating  to  a  cost  of  nearly 
$80.00) .   Comparing  the  cost  of  computation  to  the  benefits 
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derived  from  the  additional  branching,  it  was  felt  that  one 
branch  was  adequate. 

As  previously  stated,  the  main  model  was  broken  down 
into  three  submodels,  one  for  each  indicator  to  be  ranked. 
Once  the  program  has  computed  the  branch  values  in  each 
submodel,  it  proceeds  to  apply  the  techniques  that  deal  with 
uncertainty,  in  particular,  the  MAXIMIN,  MAXIMAX  and  LaPlace 
principles. 

The  MAXIMIN  principle  may  be  viewed  as  a  pessimistic 
approach.   This  principle  of  choice  suggests  that  the  maxi- 
mum of  the  minimum  gains  be  chosen,  or  select  the  best  of 
the  worst  outcomes.   In  this  section  of  the  program,  the 
minimum  value  of  each  submodel  is  selected  and  stored  in  three 
vectors  (one  for  each  indicator) .   These  vectors  are  then 
placed  in  a  47  by  3  matrix  where  the  rows  represent  projects 
and  the  columns  are  the  respective  indicators.   A  value  in 
the  matrix  is  the  minimum  value  for  an  indicator  peculiar  to 
a  project.   Once  this  matrix  is  complete,  each  column  (or 
indicator)  is  ranked  from  highest  to  lowest  Ci.e.,  the  great- 
est number  receives  rank  one,  and  so  on) .   In  the  event  of 
a  tie,  an  average  rank  is  used.   These  rankings  are  then 
placed  in  another  matrix  which  will  be  referred  to  as  the 
rank  matrix.   The  ranks  are  then  summed  across  the  columns 
(indicators)  and  then  re-ranked  from  lowest  to  highest. 
By  summing  across  the  columns,  one  is  merely  adding  the  ranks 


There  are  4  7  PIF  projects  funded  in  FY84.   These 
projects  form  the  data  base. 
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of  the  indicators  for  each  project.   Subsequently,  the 
project  with  the  lowest  combined  rank  is  the  best  project 
and  hence  the  reason  to  rank  from  the  lowest  (rank  one)  to 
the  highest.   The  result  of  this  procedure  is  a  vector  of 
4  7  elements  (one  for  each  project)  representing  the  final 
ranking. 

The  second  technique  used  is  the  MAXIMAX  principle. 
This  is  an  optimistic  approach  where  the  best  possible  out- 
come is  maximized.   The  procedure  used  here  is  identical 
to  the  MAXIMIN  computation  with  the  exception  that  the  maxi- 
mum value  in  each  submodel  is  chosen  instead  of  the  minimum. 

The  LaPlace  principle  is  computed  somewhat  differently. 
This  method  assumes  that  the  branch  values  are  equally  likely 
to  occur  within  each  submodel.   Using  this  probability  dis- 
tribution, an  expected  value  for  each  indicator  can  be  de- 
rived.  The  result  is  a  matrix  of  expected  values  for  each 
project  and  indicator.   This  matrix  is  then  ranked  using 
the  same  procedure  as  previously  discussed. 

The  ultimate  product  of  the  program  is  a  matrix  of  the 
final  rankings  of  each  product  using  each  of  the  three 
methods  of  uncertainty.   It  is  now  possible  to  judge  the 
effect  of  uncertainty  by  comparing  these  rankings  to  those 
derived  using  DPPO's  procedure.   However,  before  these 
results  are  revealed,  some  discussion  on  software  support 
for  the  model  and  problems  that  arose  during  the  develop- 
ment of  the  model  warrant  attention. 
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C.  SOFTWARE  SUPPORT 

In  the  process  of  evaluating  the  model,  two  data  files 
were  created  and  several  functions  and  programs  written. 
The  first  file,  THESISD,  is  a  47  x 5  matrix  where  the  rows 
represent  the  projects  and  the  columns  are  total  cost,  total 
savings,  manpower  spaces  saved,  NPV,  and  economic  life. 
CFMATRIX  is  the  second  file  containing  the  cash  flows  for 
each  project  over  a  period  of  2  8  years.   To  ensure  matrix 
conformability,  zeroes  had  to  be  added  to  those  projects 
whose  economic  lives  were  less  than  28  years.   These  zeroes 
are  removed  in  the  main  program  to  reduce  computations. 

The  main  program,  UNCERT,  is  written  in  APL  and  calls 
its  data  from  the  two  files.   It  internally  computes  ROI 
and  INVPERSV  branch  values,  selects  max  and  min  values  and 
calls  other  functions  for  IRR  values  (CALIRR)  and  to  perform 
rankings  (RANKUP,  RANKDN) .   A  listing  of  UNCERT  as  well  as 
the  functions  are  contained  in  Appendix  (A) .   Copies  of  the 
base  data  composes  Appendix  (B) . 

D.  PROBLEM  AREAS 

In  the  development  and  documentation  of  the  model , 
several  problems  were  encountered  which  substantially  altered 
the  procedure  to  be  used. 

The  first  difficulty  concerned  itself  with  the  INVPERSV 
computation.   The  formula  used  by  DPPO  can  be  expressed  as 


INVPERSV  -   Total  Cost m 

lNV.FiLKbV   -  Manpower  Spaces  saved  (MPS)  *         m 
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This  presents  two  problems.   First,  if  MPS  is  zero,  INVPERSV 
is  undefined  (an  MPS  of  zero  is  not  uncommon) .   To  correct 
this  deficiency,  DPPO  arbitrarily  sets  INVPERSV  equal  to 
9999.99.   Secondly,  if  MPS  is  between  zero  and  1,  then 
INVPERSV  is  greater  than  the  total  cost.   Currently,  there 
is  no  correction  for  this.   Another  difficulty  with  this 
indicator  lies  in  its  lack  of  logical  attractiveness.   Ex- 
plicitly, IRR  and  ROI  are  benefits  which  implies  bigger  is 
better.   INVPERSV,  as  presently  used,  is  a  cost  (bigger  is 
bad) .   Although  the  procedure  used  by  DPPO  takes  this  into 
account,  it  is  felt  that  the  indicator  contradicts  the  logi- 
cal flow  when  used  with  the  other  indicators. 

A  second  problem  arose  when  trying  to  duplicate  DPPO ' s 
calculations  of  IRR.   Using  Equation  (4)  and  assuming  the 
cash  inflows  were  present  value  (verified  by  DPPO  to  be 
correct),  the  IRR's  obtained  from  CALIRR  differed  from  those 
calculated  by  DPPO. 

Another  minor  discrepancy  involved  the  value  for  economic 
life.   THESISD  contained  one  value,  however,  when  calculating 
IRR,  different  economic  lives  were  obtained  using  the  cash 
inflow  information.   This  had  no  effect  on  calculations 
since  IRR  used  strictly  cash  flow  information. 

Concern  was  additionally  raised  due  to  the  fact  that 
DPPO's  final  ranking  could  not  be  reproduced.   Further  dis- 
cussions on  this  point  are  unnecessary  since  modifications 
to  the  analysis  to  be  performed  would  create  new  rankings, 
thus  eliminating  any  reason  to  duplicate  the  original  ranked  list 
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E .   PROCEDURE 

At  this  point  the  reader  should  have  an  understanding 
of  the  model,  how  uncertainty  will  be  introduced,  and  some 
problems  that  were  encountered  in  the  process.   This  section 
will:   a)  discuss  how  the  INVPERSV  problem  was  solved, 
b)  explain  how  deviation  levels  were  obtained,  c)  how  the 
IRR  confusion  was  treated  and  d)  given  an  outline  for 
sensitivity  analysis  that  will  be  performed. 

The  first  topic  is  how  to  correct  the  INVPERSV  problem. 
If  the  original  indicator  yielded  a  cost,  then  the  inverse 
of  the  indicator  would  be  a  benefit.   Additionally,  the  in- 
verse would  also  alleviate  the  problem  of  dividing  by  zero 
or  a  fraction.   However,  the  inversion  of  the  indicator  re- 
sults in  a  decimal.   By  scaling  the  result  (multiply  by  1000), 
the  indicator  becomes  more  readable  and  comparable  to  the 
other  indicators.   This  transformation  is  given  by: 


INVPERSV  =   (Total  Manpower  Spaces  Saved}  x  1QQQ    _    (?) 


Take,  for  example,  an  INVPERSV  of  275.0.   The  inverse  would 
be  0.00  36.   Scaling  by  1000  yields  3.6.   Several  things 
should  be  noted.   First,  using  a  scalar  of  1000  is  purely 
arbitrary.   Any  scalar  could  have  been  used.   Secondly,  by 
inverting  the  indicator,  the  ranking  must  be  done  from  high- 
est to  lowest.   This  did  not  change  the  original  ranking 
done  by  DPPO.   The  final  point  is  that  by  inverting,  the 
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logical  attractiveness  of  INVPERSV  is  achieved.   The  reason 
for  scaling  is  discussed  more  in  Chapter  VI  but  deals  with 
an  alternate  means  of  obtaining  a  ranking. 

In  Section  C,  the  idea  of  changing  different  variables 
(i.e.,  cost,  savings,  etc.)  was  introduced.   How  much  to 
vary  these  variables  is  what  is  of  interest  here.   In  the 
program,  deviation  levels  are  represented  as  a  vector  with 
three  elements.   These  elements  represent  variables  above 
the  projected  level,  as  projected,  and  below  projected 
levels.   That  is  to  say,  if  a  cost  overrun  were  to  occur, 
the  average  overrun  would  be,  for  example,  20  percent  of 
the  projected  cost.   This  can  be  mathematically  expressed 
as,  cost  overrun  =  1.2  x projected  cost.   Similarly,  to  main- 
tain the  projected  cost,  a  multiplier  of  1  is  used  while  a 
number  less  than  1  would  relate  a  cost  underrun.   Deviation 
levels  can  be  determined  by 


_    ^  Actual  Cost  /0, 

Cost  Deviation  =  - = r-ra — r  •      (8) 

Projected  Cost 


By  using  Sciortino's  [1]  audit  and  Equation  (8),  deviation 
levels  for  cost,  savings,  and  cash  flows  were  obtained.   Man- 
power variations,  however,  were  purely  subjective.   In 
reviewing  several  audit  reports,  there  is  no  data  to  address 
this  point.   The  deviation  levels  used  to  obtain  variations 
were  1 . 1  for  a  manpower  overrun  and  0 . 9  for  an  underrun .   The 
sensitivity  analysis  that  will  be  performed  later  will  further 
address  this  area. 
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IRR  fluctuations  created  an  area  of  concern  since  they 
could  not  be  duplicated  and  since  the  results  obtained  using 
Equation  (4)  showed  no  correlation  to  DPPO's  data.   To 
remedy  the  situation,  all  4  7  projects  were  ranked  using 
Equation  (4)  to  calculate  IRR  and  Equation  (7)  for  INVPERSV 
(ROI  calculations  were  the  same) .   The  results  of  this  run 
will  be  referred  to  as  the  DPPO  Base  since  this  is  what  the 
rankings  should  have  been  with  all  problems  aside.   Next, 
a  run  was  made  to  introduce  uncertainty.   These  results  were 
compared  to  the  DPPO  Base  to  see  if  any  significant  changes 
had  taken  place.   For  reference,  Appendix  (C)  is  the  DPPO 
Base  case  and  Appendix  (D)  displays  the  results  after  uncer- 
tainty was  applied. 

In  order  to  examine  which  variables  and  uncertainty 
methods  were  critical,  sensitivity  analysis  was  performed. 
The  variables  of  concern  are  cost,  savings  and  manpower  spaces 
saved.   Initially,  single  variables  were  used,  followed  by 
changes  in  two  variables  and  finally,  by  three.   Appendix  (E) 
contains  the  results  of  these  runs  while  the  next  chapter 
discusses  this  issue  in  greater  detail. 
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V.   RESULTS 

A.   INITIAL  COMPARISON 

DPPO's  ranking  was  computed  using  the  new  INVPERSV  and 
IRR  ranking.  The  base  case,  which  introduces  uncertainty 
into  the  ranking,  was  run  using  deviation  levels  outlined 
in  Table  I.  These  values  were  obtained  using  Sciortino's 
[1]  audit  and  Equation  (8) .  The  output  of  the  two  runs  were 
then  compared  to  determine  if  the  base  case  had  any  impact 
on  DPPO's  ranking. 

TABLE  I 
Deviation  Levels  Used  in  the  Base  Case 

Above  Below 

Projected  Projected 

Cost         1.256  0.825 

Savings/ 

Cash  Flows   1.014  0.3116 

Manpower 

Spaces      1.1  0.9 

Before  any  comparison  may  be  undertaken,  it  might  be 
beneficial  to  define  how  this  impact  is  to  be  measured.   Three 
terms  are  used  to  judge  the  magnitude  of  difference  between 
DPPO's  ranking  and  the  base  case;  1)  significant  (S)  implies 
that  5  or  more  projects  experienced  any  rank  jumps  or  any 
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two  projects  had  jumps  of  5  ranks  or  more,  2)  slightly 
significant  (SS)  is  defined  as  3  or  more  projects  had  rank 
jumps  or  any  two  projects  had  jumps  of  three  ranks  or  more, 
and  3)  no  significance  (NS)  merely  represents  any  situation 
less  than  those  described  above. 

Initially,  all  47  projects  were  compared.   This  revealed 
that  the  MAXIMIN  and  LaPlace  Principles  significantly  changed 
the  rankings  while  the  MAXIMAX  showed  little  to  no  change. 
DPPO's  rankings  were  divided  into  three  groups;  projects  ,1 
through  15,  16  through  31  and  32  through  47.   The  reason  for 
subdividing  was  to  observe  where  the  jumps  in  ranking 
occurred.   A  summary  of  the  results  is  contained  in  Table  II. 

TABLE  II 
Summary  of  Initial  Comparison 


Project 
Number 

MAXIMIN 

LaPlace 

MAXIMAX 

All 

S 

S 

NS 

1-15 

SS 

NS 

NS 

16-31 

s 

SS 

NS 

32-47 

s 

S 

NS 

Using  this  information,  it  is  evident  that  jumps  occur  more 
frequently  in  the  lower  projects.   The  reason  for  this 
occurrence  is  primarily  due  to  the  first  15  projects  offering 
significantly  greater  IRRs,  ROIs,  and  INVPERSVs  than  the 
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others.   This  information  will  play  a  role  in  performing 
sensitivity  analysis  and  therefore  the  discussion  will  be 
delayed  until  then. 

B.   SENSITIVITY  ANALYSIS 

Due  to  cost  constraints  in  running  all  4  7  projects, 
only  the  first  15  were  used  to  perform  sensitivity  analysis. 
To  begin,  a  new  base  case  dealing  with  uncertainty  was  derived 
and  would  be  used  to  compare  24  variant  runs.   The  purpose 
of  this  analysis  was  to  determine  which  variables  were 
critical  and  which  uncertainty  methods  were  sensitive  to 
the  changes.   First,  single  variable  deviations  were  analyzed, 
followed  by  two  and  three  variable  combinations. 

The  results  of  the  initial  runs  with  single  variables 
indicated  that  all  three  methods  were  insensitive  to  minor 
changes  in  the  variables  with  one  exception.   This  run  dealt 
with  increasing  the  bounds  (above  projected  and  below  pro- 
jected deviation  levels)  of  savings  by  20  percent  and  creating 
significant  rank  jumps  in  the  MAXIMIN  ranking  and  slightly 
significant  jumps  in  that  of  LaPlace. 

The  deviation  level s  were  then  preset  to  values  outlined 
in  Table  III.   It  should  be  noted  that  these  levels  are 
substantial  deviations  from  the  projected  values.   This  is 
primarily  due  to  the  nature  of  the  first  15  projects.   As 
mentioned  in  Section  A  of  this  chapter,  the  initial  compari- 
son noted  little  change  in  ranking  among  the  three  methods. 
This  is  attributable  to  the  large  variations  in  each  of  the 
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TABLE  III 
Deviation  Levels  Used  in  Sensitivity  Analysis 

Above  Projected    Below  Projected 
Cost  2.512  0.2 

Savings/ 

Cash  Flows  2.0  0.1 

Manpower  Spaces     2.2  0.2 

variables  in  the  first  15  projects  as  compared  to  the  rest. 
These  variations  are  presented  in  Table  IV.   Due  to  restric- 
tions in  programming ,  other  projects  could  not  have  been 
selectively  chosen  without  redrafting  files.   However,  despite 
this  problem,  it  is  still  possible  to  determine  critical 
variables  and  sensitive  methods. 

Table  V  conveniently  summarizes  the  results  obtained  from 
the  analysis.   A  word  on  notation  though,  might  aid  in  its 
understanding.   In  the  description  column,  the  variable  being 
changed  is  described  as  being  either  high  or  low.   High  refers 
to  an  increase  in  the  above  projected  deviation  level  only 
while  low,  decreases  the  below  projected  level.   Run  2b 
decreased  both  bounds  by  a  set  percent  and  Run  3b  increased 
both  bounds.   As  stated  earlier,  other  runs  utilizing  this 
procedure  yielded  no  changes  with  the  exception  of  3b  and, 
therefore,  eliminated  further  use  of  the  procedure. 

To  further  summarize  the  contents  of  Table  V,  it  can 
be  said  that  the  LaPlace  principle  was  the  most  sensitive  to 
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change.   This  may  be  attributed  to  the  cost-savings  rela- 
tionship and,  in  particular,  savings  deviations.   This  would 
affect  both  the  ROI  and  IRR.   The  method  was  insensitive  to 
manpower  variations.   The  only  other  method  to  show  a  reac- 
tion was  MAXIMIN .   This  is  strongly  evident  in  low  savings 
cases.   Low  savings  (implying  low  cash  flows)  will,  in  turn, 
drive  IRR  with  an  additional  effect  on  ROI.   Once  again, 
manpower  fluctuations  had  little  to  no  effect.   The  last 
principle,  MAXIMAX  showed  little  to  no  change  during  the 
course  of  the  analysis. 

To  summarize,  the  LaPlace  principle  showed  sensitivity 
to  more  variables  or  combinations  thereof.   The  MAXIMIN 
method  was  the  only  technique  to  cause  significant  jumps 
in  rankings.   With  both  methods,  savings  seemed  to  be  the 
critical  variable  indicating  that  IRR  is  the  main  driver  in 
the  rankings,  followed  by  ROI.   INVPERSV  had  little  to  no 
effect  in  the  rankings . 
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VI.   CONCLUSIONS  AND  REMARKS 

A.   CONCLUSIONS 

Since  the  objective  of  this  thesis  was  to  determine  if 
the  methods  of  risk  and  uncertainty  could  change  project 
rankings  from  the  present  procedure,  this  point  shall  be 
addressed  first.   It  is  apparent  that  both  the  MAXIMIN  and 
LaPlace  principles  will  change  the  ranking  and  their  incor- 
poration into  the  present  procedure  should  be  investigated 
as  a  short  term  solution.   Additionally,  the  LaPlace  approach 
is  recommended  above  the  others  for  several  reasons:   It  is 
not  an  extreme  selection;  it  makes  more  use  of  the  different 
outcomes  than  the  other  methods;  and  it  is  more  sensitive 
to  the  variables  and  combinations  thereof. 

This  paper  does  not  purport  to  advocate  strict  adherence 
to  methods  of  uncertainty  in  decision  making.   The  use  of 
risk  is  a  better  solution  to  solving  problems  of  this  nature. 
To  enable  the  use  of  risk  techniques,  it  is  recommended 
that  audit  reports  compare  realized  costs,  savings,  and 
manpower  to  that  which  was  projected.   Furthermore,  since 
DPPO  maintains  a  data  base  from  which  the  projects  are  ranked, 
this  data  base  should  also  serve  as  a  reference  in  doing 
audits.   As  mentioned  before,  audit  reports  should  also 
address  manpower  spaces,  which  to  this  point,  has  gone 
without  remark . 
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The  use  of  the  new  INVPERSV  and  IRR  equation  have  been 
discussed  sufficiently.   Their  incorporation  into  the 
present  procedure  is  highly  recommended. 

The  use  of  equal  weights  for  the  indicators  is  another 
questionable  area,  and  will  be  addressed  in  the  final  section 
of  this  chapter. 

Although  more  conclusions  could  be  drawn,  the  next 
section  will  introduce  a  corrective  procedure  which  would 
provide  better  and  more  accurate  rankings. 

B .   REMARKS 

The  content  of  this  thesis  introduced  the  use  of  risk 
and  uncertainty  into  DPPO's  procedure.   This  is  what  it  was 
commissioned  to  do;  however,  a  better  approach  utilizing 
multiattribute  utility  theory  may  prove  to  provide  quite 
different  results. 

The  present  procedure  has  several  flaws.   The  first  is 
using  linear  combinations  of  rankings  to  obtain  a  final 
aggregate  ranking.   Economic  indicators  are  measures  of 
effectiveness  (MOEs) .   These  MOEs  have  a  common  origin 
(zero)  and  are  measured  on  a  ratio  scale,  meaning  a  state- 
ment may  be  made  to  the  effect  that  one  IRR  is  twice  as 
good  as  another  IRR. 

The  use  of  ranks,  changes  the  scale  to  ordinal  and  this 
information  is  lost.   An  example  may  best  illustrate  this 
point.   Suppose  a  comparison  of  projects  A  and  B  is  to  be 
made.   Project  A  has  an  IRR  of  200  percent,  an  ROI  of  87 
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percent  and  an  INVPERSV  of  78.   Project  B,  on  the  other 

hand,  has  an  IRR  of  25  percent,  an  ROI  of  88  percent  and 

an  INVPERSV  of  79 .   According  to  the  present  procedure , 

project  B  is  better.   However,  if  a  ratio  scale  is  used, 

then  project  A  would  be  the  wiser  choice  since  A's  IRR 

is  8  times  greater  than  B's  with  the  other  indicators  about 

equal. 

Additionally,  the  sensitivity  analysis  pointed  out  that 
IRR  seemed  to  drive  the  rankings  with  ROI  having  a  smaller 
input.   This  indicates  that  the  use  of  equal  weights  may 
not  be  as  reasonable  as  initially  thought. 

This  topic  should  be  considered  an  area  for  future  study 
The  benefits  derived  from  it  could  be  substantial  and  lead 
to  a  more  effective  manner  to  judge  projects  and  eventually 
realize  their  benefits. 
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APPENDIX  A 
SOFTWARE  SUPPORT 

This  appendix  contains  the  programs  used  to  introduce 
uncertainty  to  the  Productivity  Investment  Fund. 
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C4j 
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12 
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16 
17" 
'18 

19; 

23' 

!24l 

25 
J26] 

27 

2Q' 
ij2?1 
'30 

'3i : 

32 
"33 

34 

35"1 
r3o 

37 
"38 

39; 

;4o; 

41 
42 

'43- 

;44; 

45 
"46' 
:47' 
"48: 

49' 
j50: 

Csi; 

52 
53' 

[54] 
55^ 
56 
57 

C58 


[591 

162 

£63' 

[64^ 

C65: 

C66 

[67; 

Ug 

[6? 


v  UNCERT 

'RUN  NUMBER:  DPPO  BASE ' 

INPUT  DEVIATION  LEVELS 


CQSTDH 
SAVD<-i 
CF  DM 
MPSD*-1 

'  'DEVIATION 
'   COST 
'   SAVINGS 
'   MANPOWER 
'   CASHFLOWS 


LEVELS : ' 
, TCOSTD 
. TSAVD 
, rhPSD 
.  TCFD 


Or-'  INPUT  TOTAL  NO  OF  PROJECTS  TO  BE  RANKED 

TN*-Q 

I«-0 

MAX  I  RR*-MAXRO  I  *-MAXMPSH..RO  I  H..MPSH)  X  (  \  TN  > 

MINIRR+-MINR0I<-«INMPSt-9999x1+0xiTN 

LIRR^LROI^-LMPSr-Ox  ).TN 
Li  :  I<-I  +  i 
ft       INSERT    DATA 

COSTr-.THESISDI'I  ;  i  1 

SAVf-.THESISDCI  ;2] 

MPS^.THESISDr.I;3l 

NPVV;THESISDCI;4"| 

CFt-,CFMATRIXTI;  ] 
ft 


PROJECT  NUMBER: ' ,Tl 


INPUT  VARIABLES 
TOTAL  COST 
TOTAL  SAVINGS 


MANPOWER 
DELETE  (>' 


TCOST 

TSAV 
TMPS 


CFt-DROP  CF 
'   CASH  FL( 


FROM  CF  VECTOR 
:  * , TCF 


i    COMPUTE  BRANCH  VALUES 

'costsh:ostxcostd 

SAVS<-SAVxSAVD 
MPSSf-MPSxMPSD 
COUNT*- $>  COSTS 

SELECT  THE  VALUES  FOR  EACH  OF  THE  PROJECTS 
ROI     MPS' 


ER0I*-EMPS*-0*l9 

J+-L*-© 
L2:  J*-J+1 

K<-0 
L3:K*-K  +  1 

L<-L+1 

EROI[L]*-SAVSrJ>rCOSTSrK] 

EMPST LI*-  <  MPSSr  J 1-COS TS CR  ]  )  X  i  (XX) 

EROIfLJ    AND    EMPSCL.1 

-HK<CQUNT)/L3 

-»(J<  COUNT  )/L2 

ft   COMPUTE  IRR  VALUES 

rt 
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70' 
•?i 

'73 

74: 

r  —*  •  • 

f6, 
'77 

78' 
79 

80" 

81 
f82: 

83; 

84' 

85 

86: 

87 
88 

'89 
90' 
'91  : 
'92 

'93' 
'94' 
'95 

96' 
'97' 

98" 
T99; 
"100^1 

1  ©  1  „ 

102J 
:i03  = 

104: 

105* 

i06 
107 
108 
109 

I  1  0 

II  1 
1  121 
i  13 

1  14 
1  15 
116 
1  17 
118 
1  19 
.120  , 
121] 

r  1 22  j 

123] 
124] 


CALIRR  CF 

fl   APPLY  LAPLACE  METHOD 

LACE  EROI 

LACE  EMPS 

•LACE  EIRR 


'LAPLACE  VALUES  FOR  ROI  IRR  AND  MPS 
LROi'Cn  AND  LIRRf.E]  AND  LMP.Vfl] 

ft   SELECT  MAX  AND  MIN 

rt 


MAXROI [ I 
hAXIRRTI 
MAXMPS[I 
MINROI f I 
MINIRRPl 
MINMPSCI 


KIVEROI) 

<-<r/EIRR) 
f-CfVEMPS) 
*-<|  /EROI) 
/EIRR) 
/EMPS) 


■*<KTN)/L1 

i  i 

'   MAXROI   MINROI    MAX IRR   MIN IRR   MAXMPS   MINMPS' 

MAXROI  AND  MINROI  AND  MAXIRR  AND  MINIRR  AND  MAXMPS  AND  MINMPS 

ft 

ft    RANK  THE  INDICATORS 

ft    APPLY  MAXIMIN  CRITERIA 
RANK  1<-RANK UP  MINROI 
RANK2+-RANKUP  MINMPS 

RANK 3<-R ANK UP  MINIRR 

MA'fRIXit-RANKi  AND  RANK  2  AND  RANK 3 

FINAL  1*-+/MATR  1X1 

F I NRANKit-R ANK  DN    FINAL1 
ft 


ft 


N0<-t7N 

RANK4»-RANKUP  LROI 

RANK5+-RANKUP  LMPS 

RANK6<-RANKUP  LIRR 

MATRIX2«-RANK4  AND  RANK 5  AND  RANK 6 

FINAL2t-  +  /MATRIX2 

FINRANK2*-RANKDN  FINAL2 


RANK7<-RANKUP  MAXROI 
RANK SHRANK UP  MAXMPS 
RANK  9<-R ANK  UP  MAX  I RR 
MATRIX3*-RANK7  AND  RANK8 
FINAL3<~*v'MATRIX3 
FINRANK3t-RANKDN  FINAL3 


AND  RANK 9 


ft 


'THE  FINAL  RANKINGS  LISTED  BY  METHOD:' 

'  PROJ  MAXIMIN  LAPLACE  MAXIMAX' 

NO  AND  FINRANK1  AND  FINRANK2  AND  FINRANK3 


v 
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1 1 

:.r 

.5: 

?i 

n  1 ; 

13 
14 

Ci5 

17 

18 

20 
21 
22 

C24] 
,25 

:26 


vCALIRKTCn 
v    Z+-CALIRR    X 
LIMIT*-O»01  XC05T 
EJ.RR+-OX  .3 
ELIFE*-pX 
CAL>Ox< lELIFE) 
' IRR    VALUES: ' 
IIt-0 
L1  :I]>II  +  1 
JJt-0 
Rf-0^3 
CFS*-XxCFDCII3 

L2:R+R+O*O01 

JJ«-0 

L3:  JJ*-JJ+1 

CALX  JJ>CFSC  JJ]*<  <  1 +R )  *  J  J ) 
*(JJ<ELIFE>/L3 
ANS+-+/CAL 
CALSUh*-ANS-COST 
UPPER+-CALSUM+LIMIT 
LGUER*-CALSUM-LIMIT 
-»<  (LOWER<;e)A<UPPER>0)  >/L4 
■»CCALSUM>0>/L2 
R<-<R-0,  105) 
•*L2 
L4:EIRRCII>R 
EIRRCIIJ 
-»<  II<  3)  /Li 


^CONVERTCaiv 

*    2>CQNVERT    X 

C0ST*-.THE5ISDr  ;  1  "I 
INDt-Ox  .47 
J>0 
[4]       Li  :  J>I  +  i 

[5]        INDCI2*-XCI3-rCOSTCI3 
■*<K4?)/L1 

■7 


[1 

C2 
[3 

:i 

C6 


vLAPLACEraiv 

9    Z*-LAPLACE    X 
[11         INDEXt-oX 
[2]         P*-1-r  INDEX 
C3j         AVG<-+/<  VAL<-Xxp) 

[4]         Z*-AVG 
v 


55 


i 
■~> 

5 

4 
5 
6 
7 
8 

Q 

10 
11 

12 
13 

14 
15_ 
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vRANKUFTm* 

?    Z<-RANKUP    X 

Y*-Xr*X] 

INDEX^-pY 

I*-© 

ANS>ft<-0i<  \pY 
Li  :  J>I  +  1 

Jt-0 
L2:J*-J+1 

-XJClNDEX>/L2 
DUP<-+/AN£ 
•*<DUP>1  >/L3 

-Kit  INDEX  >/L1 

->L9? 
L3:XX*-r/T*-+\ANS 

YY<-lXX 

F^-OxiXX 

L<-0 
L4:L>L+1 

fi;l>t..l 

■KL<XX)/L4 
RT*-  +  /F-pF 
RCIjt-RT 
-*<!<  INDEX) /Li 

L??:Z<"R 


7 

vDRO 

7    Z«-DROP 

X 

[1] 

Y*-4+X 

C2: 

Z<~44X 

* 

INDEXWZ^G) 

XX*- INDEX/ 

'  7 

i. 

ts. 

Zt-Y.XX 
7 
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APPENDIX  B 
DPPO'S  DATA  FILE 

This  appendix  contains  the  data  used  to  perform  the 
analysis. 
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Project 

Total 

Total 

Manpower 

NPV 

Economic 

No 

Cost 

Savings 

Saved 

Life 

1 

572.5 

25445.  0 

9.0 

16706.3 

5 

2 

21178.4 

154  800.0 

472.  0 

72663.3 

8 

3 

5542.2 

130072.5 

272.0 

33482.7 

25 

4 

268.0 

6151.0 

4.0 

3886.3 

5 

5 

629.9 

16255.0 

0.0 

4247.0 

25 

6 

1033.8 

5016.7 

52.  6 

2137.9 

7 

7 

784.2 

20067.5 

0.  0 

5838.7 

25 

8 

1026.4 

28292.5 

0.0 

8311.0 

25 

9 

1711.7 

27529.6 

0.0 

8820.0 

20 

10 

468.8 

2  531.0 

38.  9 

1450.0 

5 

11 

14345.0 

253374. 1 

573.0 

126215.9 

8 

12 

1894.0 

37600.0 

0.  0 

19107.9 

10 

13 

788.5 

9198.0 

7.  0 

2770.6 

20 

1U 

240.0 

3828.0 

3.  0 

1241 .2 

20 

15 

2020.0 

65214. 1 

14.5 

39210.2 

6 

16 

147.7 

1499.0 

5.  0 

689.6 

10 

17 

138.7 

1873.5 

0.  0 

1041.7 

10 

18 

126.0 

1757.2 

0.  6 

966.2 

8 

19 

245.2 

1314.4 

5.0 

568.7 

10 

20 

1871.7 

52637. 2 

0.  0 

15621.3 

28 

21 

535.3 

5  863.  0 

0.0 

3067.0 

10 

22 

476.2 

5  301.  1 

0.  0 

2876.9 

7 

23 

161.6 

1774.5 

12.0 

1183.7 

5 

24 

135.0 

10557.5 

0.0 

36  97.8 

25 

25 

290.0 

1  42  1 .  0 

16.0 

609.8 

7 

26 

420.0 

8763.0 

0.  0 

4964.2 

10 

27 

1351.8 

14999. 1 

72.0 

9803.3 

5 

28 

616.9 

21710.0 

0.  0 

7264.6 

25 

29 

363.9 

2  647.7 

11.  4 

1217.4 

10 

30 

370.0 

3439.7 

7.  6 

1866.2 

8 

31 

177.0 

1480.  0 

3.  0 

809.9 

8 

32 

173.  1 

1897.  0 

1.  8 

502.5 

25 

33 

861.3 

8366.  0 

13.7 

3811.6 

10 

34 

520.0 

12789.0 

1.  5 

5964.4 

15 

35 

908.0 

7200.0 

6.  0 

3456.7 

8 

36 

298.7 

2  36  1 .  6 

18.  0 

1276. 1 

8 

37 

935.0 

6700.  0 

44.  4 

3411.6 

8 

38 

199.0 

2460.0 

2.  0 

1301.9 

10 

39 

635.0 

4  768.  0 

15.  0 

2544.4 

8 

40 

143.3 

94  0.  8 

3.  3 

427.0 

8 

41 

262.0 

1  2  06  0 .  0 

0.3 

52  96.9 

15 

42 

5931.5 

23260.9 

651.  2 

12142.0 

8 

43 

3182.0 

45950.  0 

4.  0 

21875.3 

10 

44 

870.0 

9427.4 

13.  6 

3854.6 

12 

45 

121.0 

672.0 

2.  0 

327.1 

8 

46 

105.8 

828.0 

2.  5 

246.6 

20 

47 

294.9 

4  857.  0 

2.  0 

2418.0 

10 
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APPENDIX  C 
DPPO'S  DATA  BASE 

This  appendix  contains  the  results  from  the  DPPO 
Base  case. 
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DPPO    Base    Case    (Con1*:) 


NO 

ROI 

I  BR 

MPS 

1 

44.445 

6.626 

15.721 

2 

7.309 

0.900 

22.287 

3 

23.469 

0.58  7 

49.078 

4 

22.951 

3.654 

14.925 

5 

25.806 

0.628 

0.000 

6 

4.852 

0.67  6 

50.880 

7 

25.590 

1.014 

0.0  00 

8 

27.565 

1.092 

0.000 

9 

16.083 

0.737 

0.0  00 

10 

5.398 

1.039 

82.978 

11 

17.663 

2.287 

39.944 

12 

19.852 

1  .96  6 

0.000 

13 

11.665 

0.578 

8.877 

14 

15.950 

0.790 

12.500 

15 

32.284 

4.  567 

7.178 

16 

10.149 

1.004 

33.852 

17 

13.508 

1.26  0 

0.0  00 

18 

13.946 

1.  138 

4.761 

19 

5.360 

0.546 

20.392 

20 

28.123 

0.995 

0.000 

21 

10.953 

1.084 

0.0  00 

22 

11.132 

1.  581 

0.0  00 

23 

10.981 

2.  168 

74.2  57 

24 

78.204 

3.09  8 

0.0  00 

25 

4.900 

0.68  2 

25.1 72 

26 

20.864 

2.066 

0.000 

27 

11.096 

1.83  6 

53.262 

28 

35.192 

1.394 

0.000 

29 

7.275 

0.599 

31.327 

30 

9.296 

0.994 

20.541 

31 

8.361 

1.032 

16.949 

32 

10.959 

0.473 

10.399 

33 

9.713 

0.961 

15.906 

34 

24.594 

1.624 

2.884 

35 

7.929 

0.  978 

6.607 

36 

7.906 

0.97  5 

60.261 

37 

7.166 

0.720 

47.4  87 

38 

12.362 

1.158 

10.050 

39 

7.509 

0.925 

23.622 

40 

6.565 

0.806 

23.029 

41 

46.031 

3.039 

1.1  45 

42 

3.922 

0.763 

109.790 

43 

14.441 

0.64  1 

1.257 

44 

10.836 

0.741 

15.632 

45 

5.554 

0.677 

16.529 

46 

7.826 

0.387 

23.629 

47 

16.470 

1.631 

6.782 
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DPFO    Ease   Case    (Con't) 


THE 

FINAL  RANKING 

NO 

BANK 

1 

1 

2 

31 

3 

12 

4 

5 

5 

37 

6 

39 

7 

22 

8 

19 

9 

42 

10 

16.5 

11 

2 

12 

15 

13 

43 

14 

25 

15 

3.5 

16 

14 

17 

26 

18 

20 

19 

47 

20 

21 

21 

36 

22 

27 

23 

3.5 

24 

8 

25 

34.5 

26 

13 

27 

6 

28 

11 

29 

4C.5 

30 

24 

31 

23 

32 

45 

33 

28.5 

34 

9 

35 

36 

36 

18 

37 

32 

38 

16.5 

39 

28.5 

40 

34.5 

41 

7 

42 

30 

43 

40.5 

44 

33 

45 

46 

46 

44 

47 

10 

82 


APPENDIX  D 
UNCERTAINTY  BASE  CASE 

This  appendix  contains  the  results  of  the  initial 
runs  used  to  determine  the  impact  of  uncertainty  on  DPPO's 
current  procedures. 
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Uncertainty  Base    Case    (Con't) 

NO  MAXRCI  MINROI  MAXIER  MINIRR  5JXMPS  ^N»?| 

1  54   6270  11.7340  6.714  2-369  20.961  11.265 

2  8.9838  1.9298  0.913  0.250  29.716  15.970 

3  28.8U60  6.1962  0.593  0.247  65.437  35.167 

4  28.2090  6.0595  3.703  1.267  19.900  10-£2§ 

5  31.7180  6.8130  0.635  0.267  0.000  0-??2 

6  5    9644  ll 2812  0.686  0.157  67.840  36.459 

7  31    4520  6.7560  U028  0.336  0.000  0.000 

8  33.8800  7    2775  1.107  0.362  0.000  0.000 

9  19   7680  4.2462  0.747  0.254  0.000  0.000 

10  6.6357  1.4254  1    055  0.228  110.640  59.459 

11  21.7090  4.6632  2.320  0.734  53.259  28.622 

12  24.4000  512412  1.994  0.648  0.000  0.000 

13  14.3380  3.0798  0.586  0.186  11-837  6.361 

14  19.6040  4.2110  0.801  0.260  16.667  8.957 

15  39.6800  8.5234  4.631  1.512  2.571  5.143 

16  124740  2^6795  1.019  0.311  45.137  24.257 
7  6.6020  3.5662  1.276  0.442  0.000  0.000 

18  17.1410  3.6819  1.151  0.429  6.349  3.412 

19  6.5886  1.4152  0.555  0.121  27.189  1£-£12 

20  34   5650  7^4247  1.009  0.330  0.000  0.000 

21  13   4620  2.8917  1    099  0.341  0.000  0.000 

22  13   6820  2.9390  ll604  0.492  0.000  0.000 

23  13   4960  2.8991  2.199  0.665  99.010  53.210 

24  96.1190  20.6470  fllg  1.028  0.000  0.000 
95  6    0225  1.2937  0.692  0.136  73.563  39.534 

26  25.6440  5.5084  2.095  0.682  0.000  0.000 

27  13    6380  2.9294  1.860  0.602  71.016  38.166 

28  43.2540  912912  ll3l4  0.463  0.000  0.000 

29  8    9427  1^9209  0^606  0.185  41.770  22.448 

30  11.4220  214544  lIoOS  0.315  27.387  14.719 

31  0.277C  2.2076  1.046  0.302  22.599  12.145 

32  13   4700  2.8933  0.  U80  0.137  13.865  7.451 

33  1.9380  2.5644  0    975  0.301  21.208  11-398 

34  30.2290  6.4932  1.647  0.538  3.846  ?.067 

35  9   7461  2.0935  0.992  0.281  8.810  4.735 

36  9.7175  2.0874  o!989  0.280  80.348  43.181 

37  8.8074  1.8919  0.729  0.220  63.316  34.027 

38  15.1940  3.2637  1.174  0.380  13.400  7.201 

39  9.2288  1.9824  0.938  0.260  31.496  If. 927 

40  8.0693  1.7333  0.817  0.212  30.705  16.501 

41  56.5760  12.1530  3.081  1.008  1-526  °-§20 

42  4.8200  1.0353  0.776  0.093  1^6.380  78-669 

43  17.7490  3.8125  0.646  0.301  1.676  0-29J 

44  13.3190  218609  0.750  0.257  20.843  11.201 

45  6.8260  1.4663  0.687  0.157  22.039  11.844 

46  9.6190  2.0662  0.393  0.114  31.506  16-932 

47  20.2U30  4.3483  1.654  0.534  9.042  4.859 
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APPENDIX  E 
SENSITIVITY  ANALYSIS  RESULTS 

This  appendix  contains  the  different  computer  runs 
performed  during  sensitivity  analysis.   Descriptions  of 
the  runs  are  noted  at  the  top  of  each  output. 
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